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ABSTRACT 

Owing to its impact on the industrial economy, job 
shop scheduler and controller are vital algorithms for 
modem manufacturing processes. Hence a production 
scheduling and control that performs reactive (not 
deterministic) scheduling and can make decision on 
which job to process next based solely on its partial 
(not central) view of the plant becomes necessary. 
This requirement puts the problem in the class of 
agent based model (ABM). Hence this work adopts 
an alternative view on job-shop scheduling problem 
where each resource is equipped with adaptive agent 
that, independent of other agents makes job 
dispatching decision based on its local view of the 
plant. A combination of Markov Chain instruments 
and agent oriented analysis is used in the analysis of 
the proposed agent based model (ABM) for the job 
shop scheduling problem. The Markov Chain 
approach allows a rigorous analysis of the ABM. It 
provides a general framework of aggregation in agent- 
based and related computational models by making 
use of Markov Chain aggregation and lumpability 
theory in order to link the micro and the macro level 
of observation. Simulated annealing technique is used 
for carrying out the optimization modeling for the 
ABM. 

Keywords: Agent-Based, Scheduling, Industry, 
Machine Operation, Markov Chain 

1.1 Introduction 

In the United States alone, there are over 40,000 
factories producing metal-fabricated parts [1]. These 


parts end up in a wide variety of products sold in the 
US and elsewhere. These factories employ roughly 
over 3 million people and ship close to $ 7 billion 
worth of products every year. The vast majority of 
these factories are called “job shops”, meaning that 
the flow of raw and unfinished goods through them is 
completely random. Over the years, the behavior and 
performance of these job shops have been the focus of 
considerable attention in Operations Research (OR) 
literature. 

Manufacturing industries are facing a growing and 
rapid change. Major trends like globalization, 
customer orientation and increasing market dynamics 
lead to a shift in both managerial and manufacturing 
principles: enterprises have to become more flexible, 
open, fast, effective, self-organized, decentralized, to 
sum it up: agile [2], Manufacturing serves as a basic 
function for any agile enterprise. The call for agility 
challenges the shop floor with several problems. 
With an increasing occurrence of changes and 
dominating customer demand, management of 
manufacturing processes and the coordination of the 
multifarious resources, i.e., machines, materials, 
information, knowledge and humans, becomes a core 
task of shop floor scheduling and control algorithm 
[ 2 ]. 

An important issue in a manufacturing environment is 
the improvement of resource utilization. A classical 
way of achieving improved resource utilization is by 
using scheduling algorithms [3]. As defined by Baker 
[4] scheduling is concerned with the problem of 


@ IJTSRD | Available Online @ www.ijtsrd.com | Volume-2 | Issue-1 |Nov-Dec2017 


Page: 465 







International Journal of Trend in Scientific Research and Development (IJTSRD) ISSN: 2456-6470 


assigning a set of jobs to resources over a period of 
time. Effective scheduling plays a very important role 
in today’s competitive manufacturing environment. 
Performance Criteria such as machine utilization, 
manufacturing lead times, inventory costs, meeting 
due dates, customer satisfaction, and quality of 
products are all dependent on how efficiently the jobs 
are scheduled in the system [5], Hence, it becomes 
increasingly important to develop effective scheduling 
approaches that help in achieving the desired 
objectives. 

The scheduling and planning of production order have 
an important role in the manufacturing system. The 
diversity of products, increased number of orders, the 
increased number and size of workshops and 
expansion of factories have made the issue of 
scheduling production orders more complicated, 
hence the traditional methods of optimization are 
unable to solve them [6] [7], 

As can be deduced from these techniques, most 
approaches to job-shop scheduling assume complete 
task knowledge and search for a centralized solution. 
These techniques typically do not scale with problems 
size, suffering from an exponential increase in 
computation time. The centralized view of the plant 
coupled with the deterministic algorithms 
characteristic of these schedulers do not allow the 
manufacturing processes to adjust the schedule (using 
local knowledge) to accommodate disturbances such 
as machine breakdowns. Hence a production 
scheduling and control that performs reactive (not 
deterministic) scheduling and can make decision on 
which job to process next based solely on its partial 
(not central) view of the plant becomes necessary. 
This requirement puts the problem in the class of 
agent based model (ABM). Hence this work adopts 
an alternative view on job-shop scheduling problem 
where each resource is equipped with adaptive agent 
that, independent of other agents makes job 
dispatching decision based on its local view of the 
plant. 

2.0 Literature Review 

Scheduling, understood to be an important tool for 
manufacturing and engineering, has a major impact on 
productivity of a process [8]. In manufacturing, the 
purpose of scheduling is to minimize the production 
time and cost, by telling a production facility what to 
make with which staff, and on which machine. Cited 


publications argued that agent-based modeling is used 
because only agent-based model can explicitly 
incorporate the complexity arising from individual 
behavior and interactions that exist in the real-world. 
[9] contributed to interweaving Markov Chains and 
agent-based modeling. [10] worked on and 
represented ten well-known simulation models as a 
time homogenous Markov Chain. The author’s main 
idea is the formulation of the system configuration as 
the state space of the Markov Chain. 

[11] formulated the JSP using integer programming. 
This technique involved assuming that each job 
consist of m operations and must pass through each 
machine exactly once. All machines are available at 
time zero. Furthermore, the total number of sub lots 
is given and consistent sub lot sizes are considered. 
Concerning the limitation of this technique, [12] 
pointed out that the problem formulation used does 
not recognize the physical environment of the shop 
floor domains where interference not only leads to 
readjustment of schedules but also imposes physical 
conditions to minimize them. Still, difficulties in the 
formulation of material flow constraints as 
mathematical inequalities and the development of 
generalized software solutions have limited the use of 
these approaches. 

Furthermore, although efficient bonding and pruning 
procedures have been developed to speed up the 
search, this is still a very computational intensive 
procedure for solving large scheduling problem. [13] 
proposed a methodology for solving the job shop 
problem based on the decomposition of mathematical 
programming problems that used both Benders-type 
[14] and Dantzig/wolfe-type [15] decompositions. 
The methodology was part of closed-loop, real-time, 
two-level hierarchical shop floor control system. The 
top-level scheduler (i.e., the supremal) specified the 
earliest start time and the latest finish time for each 
job. The lower level scheduling modules (i.e., the 
infimals) would define these limit times for each job 
by detailed sequencing of all operations. A multi¬ 
criteria objective function was specified that include 
tardiness, throughput, and process utilization cost. 
The limitations of this methodology stem from the 
inherent stochastic nature of job shops and the 
presence of multiple, but often conflicting, objectives 
made it difficult to express the coupling constraints 
using exact mathematical relationships. This made the 
schedule not to converge. Furthermore the rigid 
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centralization of the scheduler made it not able to 
adjust to disturbances at the shop floor. 

[16] evaluated the use of MRP or MRP-11 to create a 
medium-range scheduler. MRP system’s major 
disadvantages are not only rigidity and the lack of 
feedback from the shop floor, but also the tremendous 
amount of data that have to be entered in the bill of 
materials and the fact that the model of the 
manufacturing system and its capacity are excessively 
simple. As can be deduced from these techniques, 
most approaches to tackle job-shop scheduling 
problem assume complete task knowledge and search 
for a centralized solution. These techniques typically 
do not scale with problem size, suffering from an 
exponential increase in computation time. The 
centralized view of the plant coupled with the 
deterministic algorithms characteristic of these 
schedulers do not allow the manufacturing processes 
to adjust the schedule (using local knowledge) to 
accommodate disturbances such as machine break 
downs. Hence a production scheduling and control 
that performs reactive (not deterministic) scheduling 
and can make decision on which job to process next 
based solely on its partial (not central) view of the 
plant becomes necessary. This requirement puts the 
problem in the class of agent based model (ABM). 
Hence this work adopts an alternative view on job 
shop scheduling problem where each resource is 
equipped with adaptive agent that independent of 
other agents, makes job dispatching decision based on 
its local view of the plant. 

3.0 Research methodology: 

A combination of Markov Chain instruments and 
agent oriented analysis is used in the analysis of the 
proposed agent based model (ABM) for the job shop 


scheduling problem. The Markov Chain approach 
allows a rigorous analysis of the ABM. It provides a 
general framework of aggregation in agent-based and 
related computational models by making use of 
Markov Chain aggregation and lumpability theory in 
order to link the micro and the macro level of 
observation. 

The starting point is a Microscopic Markov Chain 
description of the dynamical process in complete 
correspondence with the dynamic behavior of the 
agent model which is obtained by considering the set 
of all possible agent configurations as the state space 
of a huge Markov Chain. This is referred to as micro 
chain. The explicit micro formulation enables the 
application of the theory of Markov Chain 
aggregation-namely, lumpability-in order to reduce 
the state space of the micro chain and relate 
microscopic deceptions to a macroscopic formulation 
of interest. 

Simulated annealing technique is used for carrying 
out the optimization modeling for the ABM. Some of 
the conditions for asymptotic convergence, as for 
instance, the infinite length of Markov Chains, cannot 
be met in practice [1]. Hence, in any finite 
implementation, choice have to be made with respect 
to the parameter: 

- The length of the Markov Chain 

- The initial value of the control parameter 

- The decrement rule of the control parameter 

- The final value of the control parameter 

Such a choice is usually referred to as cooling 
scheduler or an annealing schedule [2], hence the use 
of simulated annealing for the global optimization of 
the ABM for the proposed JSP. 
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3.2 Proposed System 



Request production capacity 


Fig. 1: Block Diagram of the Proposed ABM Framework for Solving the JSP 


Fig. 1 presents the shop for scheduler agent, shop 
floor control (SFC) agent, order agent and the 
machine (or work station) agent. This figure shows 
the interaction between the scheduler agent and other 
agents. 

First, the agents mentioned above needs a model of 
the surrounding agents. Agents have to register 
themselves with the SFC agent. Second, resources 
like a machine (or workstation) need to notify the 
shop control agent when they have spear productivity 
capability. The order agent sends request for 
production capacity (to the scheduler agent or SFC 
agent). The function of the shop floor control agent is 
to match the request of the order agent with the offers 
of the resources on a certain instance of time. The 
SFC agent therefore uses the schedules it receives 
regularly from one or more schedules. Order agents 
and resources (or workstation) are not obliged to wait 
with their request and offers until the operation is 
executable or the resource is free. This enables the 
agents to foresee future events and consider the 
consequences of it. This will be used to have, e.g. an 
idle machine (workstation), waiting for an important 
order, even when work is available. 

In addition to the global scheduler, each machine 
(workstation) is equipped with a local scheduling 


agent that makes decision on which job to process 
next based solely on its partial view of the plant. For 
executing a schedule, the machine (workstation) agent 
needs to register itself with the shop floor scheduler 
agent. Further on, the machine agent shall inform the 
scheduler agent and SFC agent when it is available, 
occupied, or unavailable in the (near) future. When it 
becomes available again, it notifies this event to the 
scheduler agent. The scheduler agent can explicitly 
ask for the availability of the machine. The SFC 
agent, considering all available information, will 
allocate a machine (workstation) to a task. It will 
inform both the machine agent and the order agent 
requesting that task. The order agent and machine 
agent will then autonomously settle the details of the 
task to be executed. This includes setting up the 
machine i.e. the workstation, co-ordinating their 
activities in time, loading the necessary auxiliary 
resources and exchanging information like NC- 
programs. The machine (workstation), in principle, 
has the possibility to schedule the tasks. This can be 
done to account for small durations in the predicted 
processing time; to react to resource breakdown; or to 
optimize setups that have not been foreseen in 
sufficient detail on higher level. 
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4.0 Agent Structure Modeling 

In this work, the Belief - Desire - Intention (BDI) 
agent model is adopted to model the system. The BDI 
software model is one of the software models 
developed for modeling and programming intelligent 
agents [17]. 

In BDI terms Beliefs represent knowledge of the 
world. It represents information state of the agent. In 
computational terms, Beliefs represent the state of the 
world, such as the value of a variable (i.e. constraint 
variable in the proposed job shop scheduling problem 
(JSSP) model), a mathematical or logical expression 
(in this design constraint inqualities, JSSP constraint 
expressions, and scheduling constraint equations), a 
relational database and belief includes inference rules 
used by the agents that allow forward chaining that 
leads to new beliefs. 

Desire (or goals) form another essential component of 
the system state. Desire represents the motivational 
state of the agent, objectives or goal that the agent 
would like to accomplish [17]. In computational 
terms, a desire may simply be the value of a variable, 
a record structure, or a symbolic expression in some 
logic. The important point is that a goal represents 
some end state. 

Intentions represent the deliberative state of the agent, 
the agents chosen actions, which means the agent has 
begun executing a plan. Computationally, intentions 
may simple be a set of executing threads in a process 
that achieve the goals (desires) of the system. 

4.1. Specifying the BDI components of the 
proposed agent based model. 

Referring to the proposed system block diagram and 
narrative of section 3.2: 

> Scheduler Agent BDI structure 

❖ Belief 

The agent has the following belief; 

• Scheduling Constraints (Resource Constraints, 
task constraints, temporary constraints): 

This constraint, are specified in this model design in 
form of mathematical expressions, inequalities, 
logical expressions that the computed schedule 
parameter must satisfy.To this effect the scheduler 
agent, uses combinatorics (i.e a search) to generate 
scheduling values (start time for jobs, and machine) 
that ensures that the set constraints are satisfied. It 


uses constraint propagation computation to adjust 
generated values. 

• Data on available machines (i.e. available 
resources): 

The machine agent from time to time updates the 
scheduler agent on the availability of machines (in 
other words data on free machines). 

• Request Order: 

A data structure that list and stores request received 
from the order agent. 

• Job state space probability vector: 

This is data of stochastic projection received from the 
shop floor agent. The shop floor agent uses Markov 
chain to arrive at this projection. 

♦♦♦ Desire 

The scheduler agent has the desire 

• Makespan Minimization: 

The objective (i.e desired end state ) of this agent is to 
apply it’s scheduling heuristics in order to minimize 
the manufacturing makespan. 

• Assignment of jobs (unscheduled jobs, 
preempted jobs) to machines: 

The agents want to arrive at the state whereby all 
unscheduled jobs, pre empted jobs, waiting jobs are 
completely assigned to machines. 

• Constraint Satisfaction: 

The agent objective is for all mathematical constraint, 
that would be presented in detail in this chapter later 
are satisfied for whatever value of variable (e.g. start 
time, processing time etc) are computed by the 
scheduler algorithm as a possible solution to the JSSP. 

• Intention 

The scheduler agent carries out the following action 
(intention); these actions are methods or threads in 
software systems. This explains why the 
representation is in form of program function 
(methods). 

• Run scheduling Algorithm 0 

The scheduler agent runs the algorithm that schedules 
(i.e. assigns) jobs to machines. This algorithm is 
specified in this chapter. 

• Probe Resource Availability 0 

The scheduler agents continuously run the code to get 
information on available resource (machines) from the 
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order agent and machine agent. This is necessary for it 
to compute the next schedule, to update the current 
schedule or discard the current schedule. 

• Send schedule to shop floor Agent () 

This scheduler agent intention computes and sends 
schedule to the shop floor agent. It is the shop floor 
agent that executes the schedule. 

• Execute Constraint Propagation 0 

This intention is specified to run verification code by 
evaluating the various constraints that have been 
specified for the JSSP. These constraints are given as 
mathematical expression in this design. By evaluating 
constraint satisfaction for any possible solution for the 
JSSP, the agent constructs new constraints (temporary 
constraints) and updates its belief. 

> Shop floor control Agent BDI structure 

• Beliefs 

The agent has the following beliefs 

• Machine Status 

It gets knowledge (i.e data) on the status of machines 
(idle, breakdown etc) from the machine agent. It gets 
this knowledge in form of updates. 

• Manufacturing Schedule 

It gets knowledge of completed schedules from the 
scheduler agent. The schedule is the data on the 
assignment of jobs to machines. 

• Job Status 

This is the states of all jobs at time t. It has knowledge 
of the state of all jobs in the system at any time. The 
status of the job could be: Unscheduled, scheduled, 
waiting, processing, preempted (i.e stop or 
interrupted), finished. It constitutes this belief as its 
state space (£) at time t. 

• Manufacturing Request 

The encoded instruction from the order agent on the 
details of requested manufacturing. What sequence of 
operations should be carried out on a job, the 
sequence of machining required to deliver the job. 

• Order Request 

A registry data structure that constitutes a listing of 
order received. 

• Desires 

The agent desires: 


• Global optimization (Markov chain) 

The agent wants to keep the schedule optimized at 
every time t. it uses the Markov chain to project a 
forecast state space that enables the schedule agent to 
adopt its Runscheduling Algorithm() intentions. 

This is a key part of the proposed system. 

• Job and Machine (Resource) Alignment 

This agent wants to actualize the objective of 
matching job(ij) with the right machine. Its Execute 
Schedule () intentions is the action it carries out to 
realize this objective. 

• Keep Scheduler Agent Update on Job State 
Transient 

This desire is from the perspective of Markov Chain. 
The agent wants to let the schedule agent to be aware 
of the probability distribution of the non-absorbing 
states of the systems at every scheduling loop or 
scheduling window or upon request from the 
scheduler agent. 

• Intentions 

The shop floor control agent carries out the following 
actions (operations or plan execution): 

• Initiate Markov Chain () 

The agent uses the job status updates from the order 
agent to constitute the job state space vector at time t, 
it evaluates the mathematics to obtain the Markov 
transition matrix. It uses the transition matrix to 
project the initial system state space to incorporate 
stochasticity in the schedule computation of the 
schedule agent. The outcome of this intention gives 
the schedule agent the initial distribution (the highest 
probability likelihood) from which the schedule is 
computed. 

• Execute Schedule 0 

It executes the schedule from the schedule agent. The 
schedule gives this agent the required instructions on 
the allocation of operations to machines. The 
execution of the schedule enables it to pass control 
instructions to the machine agent. 

• Run Update on Allocation () 

It updates the scheduler agent belief, the machine 
agent belief and the order agent belief on machine (i.e 
resource) allocation. It also updates the scheduler 
agent on job state space at time t. 
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4.2 Modeling the Scheduling Constraints 

The core of the algorithm is the agent BDI computing 
of the schedule and Markov process. In a continuous 
and iterative process, the agent based modeling is 
used to compute and track the state of jobs to produce 
initial state distribution which is then used to initialize 
the Markov Chain to produce the optimized target 
schedule. The scheduler agent uses constraints 
programming technique to produce the schedule. 

Most scheduling problems can easily be represented 
as instances of the constraints satisfaction problem 
[18]: given a set of variables, a set of possible values 
(domain) for each variable, and a set of constraints 


between the variables, assign a value to each variable, 
so that all the constraints are satisfied. Hence the 
principle observed by the Scheduler Agent is that 
given a set of resources (i.e machines) with given 
capacities, a set of operations or activities (to be 
carried out at the machines) with given processing 
times and resource, requirements, and a set of 
temporal constraints between activities, the 
scheduling problem consists of deciding when to 
execute each activity or operations O, so that both 
temporal constraints and resource constraints are 
satisfied. 


> Makespan Objective Function 

The scheduler agent’s desire (goals) is to: 

Minimize the manufacturing completion time, or makespan (MS) for processing all jobs. Mathematically, the 
problem of minimizing the manufacturing makespan is equivalent to the following formulation (adopted from 
mixed integer programming) [ 17] 


Min Ms = f(P.. k ), Min T max 
Subject to (i.e. the constraints): 

Bjj + ^ Pjj|< Xjjk < Bj, j i = 1/2,—N, j = 1, 2, ...j(i) - 1 
K e Mjj 


(4.1) 


Constraint set (4.1) ensures that an operation or activity j + 1 cannot start before the previous 
operation j of the same job i has been completed. 


B i,J(i) + 2 p i,J(i)k - MS < 0, i = 1, 2, 


N 


.(4.2) 


K e M i,J(i) 

constraint set (4.2) ensures that the starting time and processing time of the last operation J(i) for 
job i, i = 1, 2,., N is less than or equal to the makespan (MS). 


Z Xjj k = 1, i = 1, 2,., N; j = 1, 2,.J(i).(4.3) 

Ke My 

Equation (4-3) ensure that one operation j of job i can only be performed on only one machine k at 
a time. In essence, this constraint guarantees that each job i takes only one path through the 
system. 

Xghk + Xjj k -1 < Yjjghk + Xghjjk'.(^.4) 
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i = 1, 2,., N; g = 1, 2,.,N: i*g; j = 1,2,., J(i); 

h = 1, 2,.,J(g); k e My fl M gh . 

During scheduling decision or search, the Agent uses constraint set (4.4) to restrict two operations of 
two different jobs that are scheduled on the same machine from being performed at the same time. 
Thus, only one operation of one job is always performed before the other operation of the second 
job. 

Y + Y <1, 

ijghk ghijk 

i = 1, 2,., N ; g = 1, 2,., i*g; j = 1, 2,.J(i).(4.5) 

h = 1, 2,., J(g); k e My fl M gh . 

( B ij + Pjj k Xyk) - (Bgh + Pghk x ghk) + Y ( 1_Y ghijk)- p ijk x ijk 

i = 1, 2,.N, g = 1, 2,.N, i+g; .(4.6) 

j = 1, 2,., J(g), h = 1, 2,.J(g); k e My fl M gh 

(Bgh + Pghk Xghk) “ (By + p ijk x ijk) +Y (l' Y ijghk)- p ghk Xghk.(4-7) 


i = 1, 2,. N; g = 1, 2,. ,N; i 4 g; j = 1, 2,.J(i); 

h = 1, 2,., J(g); k e My fl M gh 

The agents of constraint set (4.5) in its belief guarantees that if operation j and h from jobs i and g, 
respectively, are to be performed on the same machine k, then the two operations cannot be 
performed simultaneously. Agent implements constraint set (4.6) to ensure that if operation j of job 
i is chosen to be processed before operation h of job g, the starting time and processing time of 
operation j of job i must be less than the starting time of operation h of job g. The same logic 
applies to constraint set (4.7) for the reverse case when operation h of job g is chosen to be 
processed before operation j of job i. Agent, these constraints reinforce that one job is always 
processed before a second job on a given machine to avoid contacts. 

B j:L > Rj, i = 1, 2,.N .(4.8) 

Constraint set (4.8) ensures that the first operation of a job i cannot start before it is ready. 

Bjj > 0 i = 1, 2,.N; j = 2,.J(i).(4.9) 

MS > 0 .(4.10) 

Using the non-negativity constraints (4.9) and (4.10) the agent ensures that all starting times for 
the remaining operations and the manufacturing makespan are positive. 


@ IJTSRD | Available Online @ www.ijtsrd.com | Volume-2 | Issue-1 | Nov-Dee 2017 


Page: 472 




























International Journal of Trend in Scientific Research and Development (IJTSRD) ISSN: 2456-6470 

Xijk e {0, 1>, i = 1, 2,., N;j = 1, 2,.J(i);.(4.11) 

k = 1, 2,.,m 

Yjjghk £ t0, 1>, i = 1, 2.N, j = 1, 2.JO); 

9 = 1, 2,.N; h = 1, 2,.,J(g) 

k = 1, 2,.,m 

Constraints (4.11) and (4.12) show the integer constraints for the 0-1 variables. 

n 

Bi,j(i)+ ^ x i,j(i )k = Ci, i = 1,2.N.(4.13) 

keMi,J(i)k 


Ci - 0i - Tmax <0 i = 1, 2,.,N .(4.14) 

Tmax > 0 .(4.15) 

Constraint set (4.13) ensures that the starting time and processing time of the last operation J(i) for 

job i, i = 1, 2,.N is equivalent to the manufacturing completion time, while constraint set (4.14) 

ensures that the tardiness of job i, i = 1, 2,.N is less than or equivalent to the maximum 

tardiness. With constraint (4.15) the scheduler agent ensures the maximum tardiness value will be 
non negative. 


I ik + £r=; x i jk + l p ijk + B ij 


+ lr k Ij k + 1 + Sj = 1 X jj k Pjj k + 1 + B j k _|_ J 


(4.16) 


Constraint (4.16) established the relationships required to keep the consistency between machine’s idle time 
and machine blocking times. 

The scheduler agent makes scheduling decisions. This decision involves searches for time values (i.e start time 
of operations i on machine M k ) that satisfy all constraints as presented. 


5.1 Conclusion 

When making scheduling decision, the scheduler 
agent continuously carry out constraint propagation in 
order to determine conditions (resulting in temporary 
constraints) that a schedule must satisfy (as it relates 
to operation ordering) to meet all the considered 
constraints. This results in the scheduler activating the 
intentions that updates the time-bounds of each of the 
two operations. The algorithm specified in this work 
for the scheduler agent is based on the earliest time 
heuristics [19]. To enable the incorporation into the 
shop floor agents inference (i.e intention) the 
stochastic effect of events at the shop floor, there has 
to be a way to make stochastic projections from which 
the scheduler agents intention (Run scheduling 
Algorithm()) can optimize the schedule computation 
(which is more of a combinatorics). For the scheduler 
and shop floor agents’ deliberations (intentions) to 
factor in stochasticity, Markov Chain is integrated 


into the solution of the JSSP in the proposed model. 
The methodical leverage of the contributions of this 
work would help remove the bottleneck currently 
inherent at the shop floor towards the effective 
exploitation of these production management 
strategies. 
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